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Abstract 

Cellular behavior is governed by gene regulatory processes that are intrinsically dynamic 
and nonlinear, and are subject to non-negligible amounts of random fluctuations. Such 
conditions are ubiquitous in physical systems, where they have been studied for decades 
I I using the tools of statistical and nonlinear physics. The goal of this review is to show how 

approaches traditionally used in physics can help in reaching a systems-level understanding 
of living cells. To that end, we present an overview of the dynamical phenomena exhibited 
by genetic circuits and their functional significance. We also describe the theoretical and 
^ experimental approaches that are being used to unravel the relationship between circuit 

structure and function in dynamical cellular processes under the influence of noise, both at 
the single-cell level and in cellular populations, where intercellular coupling plays an impor- 



tant role. 

, To be published in Contemporary Physics. 

> 

^ 1 Introduction 

One of the main questions to be answered in the quest towards understanding life is how structure 
relates with function in living systems, in particular in cells. This question can be asked at many 
levels, from the microscopic scale of single proteins to the macroscopic level of complete organ- 
T-H isms. A substantial amount of evidence has recently pointed to the relevance of a "mesoscopic" 

description, at the level of networks of interacting genes and proteins that coordinately govern 
J> most cellular processes [1]. This picture has relegated the notion of "one gene, one function" 

r (and frequently "one disease" ) that guided much of genetics and molecular biology in most of 
rS the 20th century. Within that framework, countless experimental evidence was gathered that 

5^ revealed the identity of genes and proteins involved in diverse cellular functions. Using that in- 

valuable information, it is now time to rephrase the question posed above in terms of finding the 
relationship between cellular function and the architecture of the underlying genetic networks. 
Two main factors make the solution of this problem difficult. 

First, the number of proteins and genes involved in these gene regulatory networks is usually 
very large. This, together with the frequently nonlinear character of their interactions, gener- 
ates a highly complex behavior, riddled with multiple coexisting phenomena and impossible to 



1 



understand from the sum of the effects of the individual network elements. The situation is 
further complicated by the ubiquitous existence of heterogeneity and stochasticity inherent to 
the intrinsic randomness of biochemical interactions, which are forced to take place in a small 
and crowded bioreactor such as the cell. A tool frequently used to face this complexity is math- 
ematical modeling, which allows us to test what possible behaviors arise from a given molecular 
network. In the words of the computational cell biologist John Tyson, trying to understand living 
systems is "something like finding a jumble of jigsaw puzzle pieces in a paper bag". We do not 
have the model of the picture that we should put together, we are not sure whether all the pieces 
are in the bag, and we do not even have a table to test if the pieces fit together. "Mathematical 
modeling provides the table" [2]. But the use of models highlights another problem that arises 
from the large size of typical gene regulatory networks: the number of parameters to be adjusted 
is frequently tremendously large, thus the problem of fitting the model to experimental data 
becomes seriously underdetermined. 

A second factor that prevents us from relating the architecture of gene regulatory networks 
with cellular function is the fact that cellular processes are strongly dynamic. Indeed, protein 
expression in cells varies in general with time, due either to temporal changes in the exter- 
nal conditions of the cells (such as circadian rhythms originated in the suprachiasmatic nuclei 
of mammals, which affect the rest of cells in the organism via the endocrine system), or to 
self-generated dynamical behavior (such as the cell cycle in dividing cells). Thus the complex 
networks of genes and proteins mentioned above, and the intricate pattern of interactions among 
them, are far from being static. It is therefore necessary to take into account that not all network 
connections are active at all times, and that it is the dynamical pattern of connectivity what has 
to be related with cellular function. 

Fortunately, the dynamic character of gene regulation alleviates the problems caused by the 
complexity of the underlying genetic networks. First, nonlinear physics tells us that dynamical 
behavior does not require a large number of degrees of freedom. Oscillations, for instance, can 
be generated with only two degrees of freedom in continuous dynamical systems, or even with 
only one degree of freedom if delays are involved. Therefore, it is reasonable to expect (from 
the point of view of biological efficiency) that periodic cellular behaviors (such as circadian 
rhythmicity, or cell-cycle oscillations) are generated by small core genetic modules embedded 
in (much) larger genetic networks, with the additional proteins of the network being used to 
modulate the dynamics and couple it with the rest of the cell's physiology. This approach 
follows the wake of a new modular perspective in cell biology, that has been unraveling in the 
last decade [3, 4, 5]. Within this context, one can conjecture that dynamical cellular functions 
are governed by core modules of small numbers of genes and proteins, which we will call genetic 
circuits in what follows. In certain cases, such as in negative feedback loops, a careful analysis 
of the dynamical traits of the circuit's behavior may be used to determine the precise structure 
of the circuit (i.e. the specific nature of each interaction) [6]. 

A second benefit of the dynamical character of cellular processes regards the issue of parameter 
fitting. Interestingly, parameters of dynamical systems are much more strongly constrained when 
the system exhibits a time-dependent state than when it operates in a fixed-point attractor [7]. 
Indeed, a constant level of protein expression may be generated in multiple ways, while when 
protein levels exhibit a certain non-steady dynamics the number of circuits responsible (and the 
associated set of parameter values) is much more restricted. 

Thus, dynamical phenomena in cells help us determine the molecular mechanisms of cell func- 
tion by (i) allowing us to extract, from complex genetic networks, circuits with small numbers 
of elements that function as core modules generating the dynamical response of interest, and 
(ii) constraining the values of the (usually many) circuit parameters that better represent the 
operating state of the cell. This process requires a close interaction between theory and experi- 
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ments, where experimental data is used to build a theoretical model, which is then validated by 
testing whether new model predictions are verified experimentally, while the new experimental 
data obtained in this process is used to refine the model, so that the discovery cycle starts again 
[8]. In this Review, we describe several case examples where this method has been employed 
successfully, together with other phenomenology where it could be used. 

Physical approaches to biological problems have a long history. However, only recently ex- 
perimental data at the systems level has started to become available at a scale sufficient to allow 
for an understanding of how living systems (self-)organize. Using this experimental information, 
physicists are currently applying, for instance, methods from the theory of nonlinear oscillations 
and bifurcation analysis to understand the emergence of dynamical phenomena in cells, including 
periodic oscillations (such as cell cycle oscillations, circadian rhythms, and many transcription- 
factor oscillations) and excitable behavior. Another topic where physics is having a large impact 
is the identification of stochasticity in cellular behavior, and the characterization of its influence. 
Dynamical processes at the level of gene regulation are unavoidably affected by considerable 
levels of random fluctuations, or noise, which arise from the small number of biomolecules that 
participate in the biochemical reactions underlying the cell's physiology. Within that context, 
results and approaches from the theory of stochastic processes, developed during the past four 
decades by the stochastic physics community, are starting to be routinely applied to biological 
problems. The goal is to interpret experimental observations that reveal high levels of vari- 
ability, both in time and space, in the operation of genetic circuits. Finally, another biological 
question where physics is having a large impact is in the study of collective cellular phenomena, 
in which the theory of coupled oscillators is playing a key role. When the genetic circuits in 
individual cells are intrinsically dynamic, cell-cell coupling provides a mechanism for the spatial 
organization of the dynamics. In particular, relevant issues in this respect are the emergence 
of synchronization and clustering in cellular populations. These phenomena are well known in 
physical systems, and are now revealing themselves as biologically meaningful dynamical states 
that drive the spatiotemporal behavior of multicellular systems. 

This article presents an overview of the biological phenomena that can be addressed by 
the physical approaches discussed in the previous paragraph. The emphasis is placed more on 
the biological questions than in the analysis techniques themselves, since these techniques are 
rather well established in their application to traditional physics problems. The review begins by 
describing in Sec. 2 the most common theoretical and experimental methods that are being used 
in those studies, followed in Sec. 3 by examples of dynamical processes in genetic circuits that 
have been identified experimentally in recent years. Section 4 describes the experimental methods 
that have been devised in recent years to quantify and characterize stochastic fluctuations in cells. 
This Section also discusses how standard theoretical approaches to stochasticity are being applied 
to understand the effects of noise in genetic circuits. Finally, Sec. 5 describes how macroscopic 
behavior emerges in cell populations from the organized activity of the individual genetic circuits 
operating in each cell. The different types of cell-cell communication mechanisms that couple 
these circuits together are discussed, and recent studies of cell population dynamics and its 
potential role in the organization of multicellular organisms are reviewed. 

2 Characterizing dynamical phenomena in genetic circuits 

The behavior of a living cell (its phenotype) is governed mainly by the collection of distinct 
proteins existing within the cell at any given time. Proteins are the basic components of the 
majority of structural elements inside the cell, and perform most of the catalytic biochemical 
reactions on which life depends. Each protein is created (expressed) from a given gene via 
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transcription of that gene into a messenger RNA (mRNA) molecule, which is further translated 
into the sequence of amino-acids that constitutes the protein. The entire process of protein 
expression is subject to regulation, specially by proteins themselves. By way of example, certain 
proteins called transcription factors bind to small pieces of DNA known as promoters, which 
precede a given gene and enhance its expression by promoting the recruitment of the enzyme 
RNA polymerase (RNAp), which transcribes the gene into mRNA. These transcription factors 
are thus called activators. A second class of transcription factors (repressors) interfere with 
RNAp binding and thus inhibit transcription. 

Glossary: terms commonly used in the study of genetic circuits 

Antibody - protein used by the immune system to identify foreign molecules, in particular other 
proteins, by binding to them with high specificity. Antibodies are routinely used, in combination 
with diff'erent kinds of markers, to monitor the presence of proteins of interest in a sample via 
multiple methods, as discussed in Sec. 2.2. 

Apoptosis - molecular process through which a cell kills itself. 

Enzyme - protein that increases the rate of occurrence of (i.e. catalyzes) a given chemical 
reaction. The input of the reaction is called the substrate, and the output is called the product. 

Eukaryotic cell - cell in which the genetic material is enclosed in a nucleus (e.g. yeast and the 
cells of higher organisms, including animals and plants). 

Gel electrophoresis - technique used for the separation of biological macromolecules such as 
DNA, RNA or proteins, in terms of their mobility through an agarose gel under the action of 
an electric field. 

Lysis - process through which a cellular membrane is broken open, so that the inner components 
of the cell are spilt to the extracellular medium. 

Pluripotency - property of a stem cell that allows it to differentiate into any cell type of 
the body. It should be distinguished from totipotency, which arises when the cell can also 
generate extraembryonic tissue (such as the placenta), and from multipotency , which refers to 
the potential to generate several cell types within a limited number of lineages (such as different 
types of blood cells, which arise from multipotent hematopoietic stem cells) . 

Polymerase chain reaction (PCR) - iterative process through which the number of copies 
of a DNA fragment is increased exponentially. It is based on the separation of the two DNA 
strands (denaturation) , followed by the synthesis of the corresponding complementary strands 
(so that one copy of the DNA fragment produces two) , after which the process is repeated again 
giving rise to a chain reaction. 

Prokaryotic cell - cell without nucleus or other membrane-bound organelles (mainly bacteria). 

Promoter - piece of DNA usually preceding a gene, to which RNA polymerase and transcription 
factors bind, thus controling expression of the gene. 

Ribosome - cellular complex that assembles proteins using an mRNA molecule as a template. 
The ribosome itself is formed by both proteins and RNA. 

RNA polymerase - enzyme that assembles RNA molecules using a DNA strand as a template. 

Suprachiasmatic nucleus - collection of around 10,000 neurons located right above the optical 
chiasm in the brain, responsible for the generation of circadian rhythms in higher organisms. 

Transcription - process through which an mRNA molecule is created from a gene. 

Transcription factor - protein that controls the transcription of a given gene by binding to 
its promoter, either activating or inhibiting it. 

Translation - process through which a protein is generated from an mRNA molecule. 

Regulation can also arise at the post-transcriptional level, for instance by means of RNA 
interference, which arises when small RNA molecules attach to a given mRNA molecule and 
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induce its degradation [9]. Finally, regulation takes place at well at the post-translational level, 
through processes such as phosphorylation (which usually turns a protein into its active form) 
and proteolytic degradation. 

In any case, gene regulation provides a rich source of feedback in the expression process, either 
at the level of a single protein (i.e. of a protein on itself) or at the network level (i.e. of a protein 
on others that might, in turn, act back upon it). Considering that expression and regulation 
processes are frequently nonlinear (see Sec. 2.1 below), these feedbacks lead to a rich amount 
of complexity, which allows for instance the coexistence of multiple phcnotypes within the same 
genotype (think for instance of the many distinct cell types in our body). In this Section, we 
present a brief overview of the methods, both theoretical and experimental, used to describe the 
dynamical behavior of small collections of genes and proteins interacting with one another via 
gene regulation processes. 



2.1 Theoretical tools 

2.1.1 Deterministic description of gene-circuit dynamics 

The expression and regulation processes described in the previous paragraphs can be represented 
mathematically, in a first approximation, by means of standard rules of reaction kinetics. These 
rules are grounded on the law of mass action^ according to which the rate of a chemical elementary 
process is proportional to the product of the concentrations of the molecular species involved 
in the process, the proportionality constant corresponding to the reaction rate. Consider for 
instance the well-known case of the simple enzyme catalysis reaction: 

E + S , [ES] > E + P 

Here E represents the enzyme, which transforms a substrate S into a product P through the 
creation of a complex [ES] . Interestingly, this reaction scheme can also represent transcriptional 
regulation in its simplest form, provided E is interpreted as the gene promoter, S as the tran- 
scription factor, and P as the mRNA that results from the transcription process^. We will refer 
to this latter interpretation, without loss of generality, in what follows. 

The equation describing the dynamics of the complex formed by the promoter and the tran- 
scription factor can be derived from reaction kinetics: 

^&=k,E-S-{k^, + K,)[ES], (1) 
at 

where now E, S, and [ES] represent the concentrations of the corresponding species. Assuming 
that the complex relaxes to its instantaneous steady state {d[ES]/dt = 0) much faster than the 
other species, and taking into account that the promoter copy number does not change during 
the transcription process {E+[ES] = Et), one can establish the dependence of the instantaneous 
concentration of the complex in terms of the transcription-factor concentration as 

dt ^ ^ k^i+kt, + kiS fcact+S" ^ ' 

where fcact = (fc-i + ^tr)/fci- This is referred to as the adiabatic elimination of the fast variable 
[ES]. With this approximation, the rate of mRNA production can be calculated as 

§ = ktAES] = y^, (3) 

dt fcact + S 

^in this case S would also be a product of the reaction producing P, since the transcription factor does not 
disappear from the system upon transcription, but this will not affect the discussion below. 
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where /3 = ktrEx depends both on the rate of production of mRNA from the complex and on 
the promoter copy number^. When multiple units of the transcription factor S are necessary to 
activate transcription (a condition known as cooperativity) , and assuming that its multimerization 
(taking place either prior to or after binding to the promoter) occurs again much faster than 
other reactions in the process, one can reach in a straightforward way the following expression 
for the mRNA production rate: 

dP ^ PS- 

dt k2,, + ^ ' 

This expression corresponds to a Hill function, with the Hill coefficient n representing the degree 
of cooperativity of the transcription process. Figure 1(a) represents the mRNA production rate 
dP/dt (which we will also call promoter activity in what follows) versus the transcription factor 
concentration S for increasing levels of cooperativity n. The figure clearly shows that a high 
enough cooperativity leads to an abrupt transcriptional switch, with fcact = [(^-i + fctr)/fci]^^" 
being the activation threshold. 




200 400 600 800 1000 200 400 600 800 1000 

activator concentration (nIVI) repressor concentration (nIVI) 



Figure 1: Rate of mRNA production (transcription rate, dP/dt) versus transcription factor 
concentration S for the cases of activation [plot (a), Eq. (4)] and inhibition [plot (b), Eq. 
(5)]. Different lines correspond to different cooperativity coefficients n. Parameter values are 
/? = 0.35 nM/s, fcact = fcrep = 500 nM. 

The case of transcriptional repression can be treated analogously, with the basic reaction 
scheme and resulting mRNA production rate being 

fcl fctr ,jp R 

where the repression threshold is fc^cp = (fc_i/fci)^/". Figure 1(b) shows the production rate of 
mRNA for the case of transcriptional repressor, for increasing concentrations of repressor and 
for varying levels of cooperativity. The switch-like character of the repression for high enough 
cooperativity is again obvious. 

The expressions given in Eqs. (3) and (5) describe the creation of mRNA molecules, which 
will be later translated into proteins by ribosomes. In general we can assume the protein pro- 
duction rate to be proportional to the mRNA concentration, provided we neglect translational 
regulation. On the other hand, dilution of the mRNA and protein molecules due to cell growth 
(and eventually cell division) lead to a concentration decrease at a rate that can be considered 
proportional to the concentration, barring any regulated degradation mechanism. 



In the context of enzyme kinetics, this equation is Icnown as the Michaelis-Menten equation. 



6 



One-dimensional dynamics With the previous ingredients we can now model the two sim- 
plest genetic circuits, namely a single protein that either activates or represses its own expression. 
Representing by A the protein concentration and by a the corresponding mRNA concentration, 
we can write the following dynamical equations for the self-activation circuit [plot on top of 
Fig. 2(a)]: 

—r = : Oafl , —r- — Pt\a ~ oaA , (5) 

dt k2^^ A" ' dt ^ ' 

where /3tx is the transcription rate at saturation, /3ti is the translation coefficient, and Sa and Sa 
are the linear degradation rates of the two species. In bacteria such as E. coli, mRNA degrades 
on the order of a few minutes, whereas proteins degrade on the order of hours (limited by the 
growth rate) [10]. In those conditions, we can assume a to relax quickly to its instantaneous 
steady state {da/dt = 0), so that we are left with only one degree of freedom. A, whose dynamics 
is given by 

^SA. (7) 

Here /3 = AxAi/'^a, and the subindex in the degradation rate of A has been dropped for com- 
pactness. The dynamical behavior of this circuit can be qualitatively established by plotting the 
right-hand-side of Eq. (7) versus the phase line defined by the A axis, as shown in Fig. 2(a). The 
zeros of that function correspond to the fixed points of the system, while in the non-zero regions 
its sign determines in an unambiguous manner (since the system is deterministic) the tendency 
in time (towards growth or decay'') of A. In that way, the sign of the slope of dA/dt at the fixed 
point dictates the stability of the fixed point; a negative slope corresponds to a stable fixed point 
(solid circle in the figure), towards which the circuit tends at long times. The unstable fixed 
point (empty circle) separates in the phase line basins of attraction of different stable states. 
The figure clearly shows that for the conditions considered (basically high enough cooperativity) 
transcriptional self- activation leads to a bistable response. 

The case of self-repression [plot on top of Fig. 2(b)], on the other hand, is represented by the 
following dynamical equation 

dA ^ (3 

whose phase-line representation is shown in Fig. 2(b). Only a single stable steady state exists, 
corresponding to the homeostatic behavior characteristic of negative feedback circuits. Multiple 
examples of these two types of minimal circuits (positive and negative self-feedbacks) exist in 
the literature (see for instance [5] for a review). 



Two-dimensional dynamics Including only one additional species in a genetic circuit leads 
to a qualitative increase in the richness of the system's behavior. The simplest example is given 
by the activator-repressor system depicted in the top panel of Fig. 3: a protein A activates its 
own expression and that of a second protein B, which in turn inhibits the activity of protein A. 
There are different ways in which such a circuit can be implemented, depending in particular on 
whether the different interactions are transcriptional or post-transcriptional. We now consider 
one of the most common situations, in which both activations occur at the level of transcription, 
while the repression of A by B takes place at the protein level, for instance by means of the 
degradation of A being induced by B. 

Using the rules described in the previous Section, which include the adiabatic elimination of 
the dynamics of the mRNA of A and B, the dynamical equations that describe the behavior of 

•^Note then that a genetic circuit with only one degree of freedom cannot oscillate (unless there are delays [11]). 
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A (nM) A (nM) 

Figure 2: Phase- line diagrams of the dynamical equations of a self- activating (a) and a self- 
repressing (b) circuit. Solid (empty) circles correspond to stable (unstable) fixed points. The 
two cartoons in the top row show schemes of the corresponding genetic circuits. In those schemes, 
arrows represent activation and blunt lines denote inhibition. Parameter values are those of Fig. 1 
with n = 4, plus S = 1.22 h"^ 



the activator-repressor circuit of Fig. 3 are: 



^^aA + - gAB - 6aA (9) 

dB PbAp 

Here we have considered that the regulated promoters from which A and B are expressed are both 
leaky, since they can exhibit a certain level of activity (which we assume below to be relatively 
small), measured by a a and ub, even in the absence of the activator A. 

In order to determine the type of behavior exhibited by this system, we can represent, in 
the phase plane formed by the protein concentrations A and B, the loci of points for which 
the respective time derivatives are equal to zero, known as nullclines. These curves separate 
regions in phase space with differing tendencies of growth/decay of the two proteins (depending 
on the sign of their derivatives), and their crossings correspond to fixed points whose stability 
depends on the signs of the eigenvalues of the Jacobian matrix at those points [12]. Figures 3(a- 
d) display two qualitatively different behaviors that the activator-repressor circuit can exhibit. 
In Fig. 3(a), the nullclines cross at a fixed point which happens to be unstable, and the circuit 
is eventually forced to oscillate, with the repressor chasing (and silencing) activator pulses in a 
periodic manner. Figure 3(c) shows the time series corresponding to this limit cycle behavior. 

In the regime depicted in Figs. 3(b,d), on the other hand, the nullclines cross at a stable 
fixed point, but the relaxation towards this stable state takes the form, for perturbations above 
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Figure 3: Dynamics of an activator-repressor genetic circuit (top panel). Phase-plane portraits for 
oscillatory (a) and excitable (b) dynamics are shown. In those plots, the magenta and pale blue 
lines correspond to the nuUclines, the thin black line to a sample trajectory, the empty diamond 
to an unstable spiral point, and the solid circle to a stable fixed point. Plots (c) and (d) show time 
traces corresponding to the two regimes, oscillatory and excitable, respectively. Finally, plots 
(e) and (f) represent two different bifurcation routes leading to genetic oscillations. In those 
plots, the solid black line denotes a branch of stable fixed points, the dashed one corresponds to 
unstable fixed points, and the red line stands for a branch of stable limit cycles. The common 
parameter values are aA — 0.005 nM/s, as = O.OI nM/s, /3a = 15 nM/s, (Sb — 2 nM/s, 

n = p = 2. 



g = 2.5 • lO-'^ nM-is~\ (5a = 5 • 10-'"^ s-^, Sb = 5 ■ IQ-^ s-\ kA = 2000 nM, fcs = 750 nM, 
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a certain threshold, of a large excursion in phase space. This so-called excitable regime exists 
in a region of parameter space close to the oscillatory regime. There are several ways in which 
the oscillations can emerge in a two-component genetic circuit such as the one described above. 
This can be revealed by making use of numerical continuation software, such as AUTO [13], 
which allows us to track how the circuit's invariant sets (either fixed points or periodic orbits) 
change as a given parameter (or set of parameters) varies. Figures 3(e,f) show two bifurcation 
diagrams exemplifying two different scenarios for the emergence of oscillations and excitability. 
In Fig. 3(e) the limit cycle emerges from a supercritical Hopf bifurcation (HB) as the constitutive 
expression rate of A, a a, decreases. In that case, the limit cycle (red branch) is born with zero 
amplitude (and non-zero frequency, see for instance [12]). Excitable dynamics exists at the right 
of the bifurcation and close to it. 

In the scenario of Fig. 3(f), on the other hand, the oscillations are born from a saddle- 
node on an invariant circle (SNIC) bifurcation as aA increases from the left, and they die via 
a supercritical Hopf bifurcation as that parameter increases further. In the SNIC bifurcation, a 
standard saddle-node bifurcation, in which a stable node and a saddle mutually annihilate after 
colliding, takes place directly on top of a limit cycle, which disappears (or is created, depending 
on the direction on which the bifurcation is traversed) as a result of the collision. The limit cycle 
is born, as a a increases, with non-zero amplitude (and zero frequency, see for instance [14]). 
Here the excitable dynamics occurs at the left of the SNIC bifurcation point. 

Bifurcation analyses such as the ones described in the preceding paragraphs are powerful tools 
to validate mathematical models of genetic circuits, since they provide predictions, frequently 
non-trivial, that can be validated experimentally. To that end, an appropriate bifurcation pa- 
rameter has to be chosen, which can be perturbed experimentally in a controlled way. We discuss 
an example of this approach in Sec. 3.2 below. 

Both the dynamical behaviors and the circuit architectures discussed so far in this section 
are the basic building blocks of natural genetic circuits, as will be shown in Sec. 3. Even though 
graphical methods such as the ones exemplified in Figs. 2 and 3 cannot be used when the circuits 
have more than two degrees of freedom, the fixed points and their stability can be computed, 
and numerical continuation methods can be used to determine the bifurcation structure in which 
a given dynamical phenomenon is embedded. In that way, we can use dynamics to determine 
molecular mechanisms of cellular function. 

2.1.2 Stochastic description of gene-circuit dynamics 

The description that has been advocated in the previous section, based on ordinary differential 
equations, assumes that the number of molecules in the different species of the circuit is large, 
so that it can be considered to vary in a continuous manner as time evolves. Additionally, 
the cell's contents are presumed to be well mixed, so that the rules of reaction kinetics can be 
applied. These assumptions, however, are frequently implausible. To begin with, one of the 
species involved in the transcription process, namely the DNA promoter, often occurs only in a 
single copy inside the cell. It is thus unrealistic to assume that the transcription reaction can 
be described in a continuous manner, unless the number of mRNA molecules produced per unit 
time is large. 

A frequently used tool to describe the discrete evolution of molecule numbers in genetic 
circuits is the direct numerical simulation of the underlying reactions via Monte Carlo methods 
[15]. A highly popular version of this approach was developed in the late 1970s by D. Gillespie 
[16], and is still commonly used. In its simplest implementation, the method relies on iteratively 
estimating the next biochemical reaction that should take place, based on the propensities of 
all the reactions that form the circuit, and update all the molecular species accordingly. Many 
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alternative, faster and more efficient, implementations of Gillespie's method (both exact and 
approximate) have been developed over the years (see for instance [17, 18, 19] for the most 
popular ones). Software packages have been created to perform discrete simulations using this 
type of algorithm in a user-friendly manner in different platforms, such as BioNetS [20] and 
Dizzy [21]. Finally, it is worth mentioning that from this fully discrete description of the circuit 
dynamic, one can develop a continuous description, which still incorporates stochastic effects, in 
the form of a chemical Langevin equation [22] . From this type of mesoscopic description, standard 
analysis tools from statistical mechanics can be used. For a generic case of N molecular species 
involved in M biochemical reactions, the chemical Langevin equation takes the form 

M M 

-^=Y. ^r.%(X(0) + E ■/'(X(i))e,(i) (11) 

Here Xi{t) denotes the molecule number of species i (i — 1...N), Vji represents how many 
molecules of species i are produced in reaction j, aj(X(i)) stands for the propensity of reaction 
i (which follows the law of mass action described in Sec. 2.1.1), and £,j{t) is a Gaussian white 
noise uncorrelated between different species. Equation (11) represents a set of coupled stochastic 
differential equations with multiplicative noise, which has to be interpreted according to Ito 
(since the model describes population dynamics [23]). Models within the class of Eq. (11) have 
been used for years to study multitude of physical systems (see, for instance, Refs. [24]). Early 
systematic studies of this type of stochastic description applied to genetic circuits can be found, 
for instance, in Ref. [25]. 

In order to visualize the effects of stochasticity in gene regulation, let us consider an extremely 
simple situation in which a gene is constitutively transcribed and translated with constant, unreg- 
ulated rates, and both the resulting mRNA and protein decay linearly by dilution, as explained 
above. In a continuous deterministic description, the system is obeyed by the trivial linear differ- 
ential equation dA/dt = a — SA, so that A tends to a steady state value a/ 6 with characteristic 
time S~^. The discrete behavior of this process will have to take into account the transcription, 
translation, and degradation reactions: 

fctx 

Pa ^ PA+a 

hi 

a *- a + A 



^dcg,a 



*dcEr,A 



A 



Figure 4 shows the stochastic dynamics of this system for two specific sets of parameters, 
representing the limits of low (a) and very high (b) noise. In the case of small noise levels, 
the number of protein molecules fluctuates around its deterministic steady state (dashed line) 
with small-amplitude fluctuations. Such an expression level corresponds to having around 2-3 
molecules of mRNA continuously present in the cell [a number that is subject to substantial 
fluctuations, as shown in the lower plot of Fig. 4(a)], from which translation occurs in a more or 
less continuous manner. The limit of large noise, on the other hand, arises when the transcription 
rate is extremely small, so that usually there is only one mRNA or none present at any given 
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Figure 4: Stochastic expression of a constitutive gene. In the two panels, the upper row shows 
the temporal dynamics of the protein level, and the lower row that of the mRNA level. In the top 
row, the thin dashed line represents the solution of the deterministic (continuous) limit. Panels 
(a) and (b) correspond to the limits of low (a) and high (b) noise level. The parameter values 
are /cdog.a = 5 • 10"^ s-\ fcdcg,A = 0.01 s'^, and (a) fctx = 0.025 nM/s, fcti = 0.2 nM/s, (b) 
/ctx = 2.5 X 10-* nM/s, fcti = 20 nM/s. 



time, as shown in the lower plot of Fig. 4(b). In these conditions, and if the translation rate 
is sufficiently high, protein production occurs in bursts, leading to a highly irregular evolution 
of the protein level, as shown in the upper plot of Fig. 4(b). Since this model is linear, it can 
be solved exactly, as discussed in [26] (see also [27] for a related calculation). The resulting 
distribution of protein levels is a Gamma function with qualitatively different shapes for the two 
cases shown in Fig. 4 [26] . Translational bursting has been observed experimentally in bacteria 
via both enzymatic [28] and fluorescent-protein [29] markers (see Sec. 2.2 for a discussion of 
experimental methods). Noticeably, the analytically obtained Gamma distributions in protein 
levels are asymmetric, which qualitatively agrees with experimental observations [30, 31, 32]. 
This provides further support to the analytical considerations made above. 

Interestingly, studies of stochastic gene expression in eukaryotic cells [33, 34, 35, 36, 37] 
yielded results which were not compatible with the translational bursting scenario described 
above, but rather with a situation of transcriptional bursting, in which it is the mRNA, and not 
the protein, that is being produced in bursts. This behavior is compatible with a situation in 
which the DNA promoter undergoes transitions between active and inactive states, during which 
the gene is being transcribed or it is not, respectively. This suggests the presence in eukaryotes 
of transcriptional regulation mechanisms in addition to those found in prokaryotes [38] , but the 
nature of these mechanisms is still open to debate. 

2.1.3 Spatio-temporal stochastic description 

All the methods proposed so far have ignored the spatial distribution of biochemical species inside 
the cell. Certainly, taking into account, in a model of gene regulation, the tremendous structural 
intricacy of a cell's interior would be an extremely arduous (and probably unnecessary) task. 
However, it is not so clear that one can ignore the effect of the spatial distribution of biochemical 
species with respect to their binding targets, when considering the time scales in which reactions 
take place inside the cell. With this in mind, in recent years different groups have developed 
generalized stochastic algorithms that allow the simulation of the dynamics of genetic circuits, 
taking into account that biomolecules are reacting inside a spatially extended system. The 
molecular motion is usually allowed to be governed by diffusion, and the cytoplasm is normally 
considered a homogeneous medium. 

Two main approaches have been considered so far. In the first approach, space is discretized 
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and a reaction-diffusion master equation is written down and integrated [39, 40, 41] . In the second 
description, the motion of individual particles is described in terms of Brownian dynamics, and 
reactions are accounted for when molecules collide within a certain range [42, 41]. A combination 
of both approaches, leading to a more efficient algorithm and based on the so-called Green's 
function reaction dynamics, was proposed in [43]. 

2.2 Experimental tools 

We now compare the different experimental methods currently available for monitoring the dy- 
namical behavior of genetic circuits. A scheme representing the different techniques is shown in 
Fig. 5. 

2.2.1 Population techniques 

The molecular biology revolution of the past 40 years has provided us with an excellent knowledge 
of the identity of the genes and proteins that underlie most cellular processes, and in many cases 
of the interactions between them as well. Interestingly, a large fraction of that information has 
been obtained with population-level techniques, which are not able to discern individual cells. 
Western blotting, for instance, is routinely used to detect the presence of a given protein in tissue 
or cell extracts, where cells have to be lysed and their contents mixed with all other cells in the 
sample, thus destroying the cells' individuality. Protein detection is made in two steps: first, 
the protein of interest is separated according to its size via gel electrophoresis; and second, an 
antibody specific to the protein and containing an appropriate marker is applied to the sample 
to detect the amount of protein present [44]. The process has to be repeated for a different cell 
population at different time instants, if one wants to track the dynamical behavior of the system. 
This makes the process rather time-consuming for monitoring the dynamics of genetic circuits. 

Population techniques ^ Single-cell techniques ^ 



immunofluorescence 




Figure 5: Scheme representing the different experimental techniques for monitoring gene circuit 
dynamics described in the text. 
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Similar constraints are faced by reverse-transcription polymerase chain reaction (RT-PCR), a 
widely used method to detect RNA presence in a cell sample [45] . The technique uses the enzyme 
reverse transcriptase to generate the complementary DNA (cDNA) corresponding to the RNA 
molecule of interest, and amplifies it via standard PGR. Real time RT-PCR uses then fluorescent 
dyes that attach to the DNA, to provide an accurate (and very sensitive) quantification of the 
original amount of RNA present in the sample [46]. As in the case of western blots, cells are 
lysed in the PGR process, so that the method is not able to monitor the behavior of single cells. 
The temporal resolution of the measurements is again naturally limited. 

In the two methods described above, it is difficult to scale up the number of different species 
that can be probed simultaneously. A technique that allows us to monitor the expression of 
a very large number of genes simultaneously is based on the use of DNA microarrays. These 
are chips containing thousands of DNA probes that hybridize cDNA molecules corresponding to 
RNA molecules of interest [47] . Hybridization of a given cDNA thus indicates that the matching 
RNA is present in the sample. Again, however, cells have to be destructed to generate the 
sample, so that this technique is not able to account for expression in single cells, nor it is fit for 
dynamical measurements. 

2.2.2 Single-cell techniques 

None of the techniques discussed so far is able to quantify the amount of expression exhibited by 
single cells. This problem can be solved via immunofluorescence. This technique uses antibody 
staining, discussed above in the context of Western blotting, in samples of intact cells, which 
have to be fixed and permeabilized, so that the fiuorescencently-tagged antibody can reach its 
target inside the cell [48]. This kills the cells and prevents tracking them in time, but allows us 
to quantify, via microscopy, the amount of protein present in a relatively small number of cells 
(those that fall within the field of view of the microscope). Several proteins of interest can be 
monitored simultaneously (limited by the availability of antibodies and the cross-talk between the 
emission bands of the fiuorophores). A technique with similar capabilities that has been employed 
profusely in recent years is single-molecule RNA fluorescence in situ hibridization (RNA-FISH) 
[49]. In this case, multiple short fiuorophore-labeled oligonucleotides are introduced in fixed 
cells. The oligonucleotides are designed so that they all bind to different parts of the same RNA 
molecule. Cooperative binding of all the oligos leads to a relatively strong fiuorescence signal 
coming from a single RNA molecule. In that way, single-molecule sensitivity can be achieved 
[50]. Again, cells must be fixed and permeabilized, so that cell tracking in time cannot be 
performed. On the other hand, the method is relatively simple to implement, since no specific 
labeled antibodies need to be used, and genes for fiuorescence proteins do not need to be cloned 
into the cell's genome (see below). 

In immunofluorescence and RNA-FISH, the number of cells that can be tracked is limited by 
the size of the field of view of the microscope. A single-cell technique that allows the quantification 
of protein expression of a very large number of cells is flow cytometry. In this widely used 
technique, cells suspended in a liquid flow pass through a laser beam. The light scattered from 
each cell provides information about its morphology, while fluorescent light (emitted by probes 
that the cell might contain) gives information about its chemical state (such as the expression 
level of a labeled protein, for instance). Since a very large number of cells pass through the laser 
beam every second, single-cell information about a very large number of cells can be compiled in a 
short amount of time. The number of proteins that can be probed depends on the number of tags 
that the cell contains, and is limited again by the spectral cross-talk between the fluorophores. 
The efficiency of the technique can be enhanced by allowing for the simultaneous analysis of 
multiple samples via a "bar-coding" method. In this method, different samples are labeled with 
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distinct intensities of a fluorophore (the barcode) and mixed together, prior to antibody staining 
and analysis by flow cytometry. After the analysis, the samples can be separated from one 
another by the fluorescence intensities of their barcodes. In that way, tens of samples can be 
analyzed in a single experiment, which greatly reduces the amounts of antibody required [51]. 
Also, adding an electrostatic deflection system to the devices, cells can be sorted depending on 
their fluorescence, a technique that is known as fluorescence- activated cell sorting (FACS) [52]. 

Due to the high number of cells that can be analyzed by flow cytometry in a single run, 
that method is able to generate in a relatively straigthforward way distribution functions of the 
state of a cell population, relative to the expression of a given protein. In that way, it can be 
established whether a genetic circuit has a bistable behavior or a simpler monostable one, for 
instance. However, as in all techniques discussed above, this method is not intrinsically prepared 
to provide dynamical information, since different cell populations must be used for different time 
points, and the cells cannot be individually tracked. 

All the techniques described above have been tremendously useful over the years in providing 
information about the molecular determinants of cellular function. However, as mentioned in the 
introduction and described in detail below, many cellular processes are dynamical and subject 
to random fluctuations. Thus usually cells in a population behave differently from one another, 
and from time to time. An experimental technique that allows us to track the biochemical 
state of single cells over time is time-lapse fluorescence microscopy. This technique heavily 
depends on fluorescent proteins, which contain a chromophore that, when excited by light within 
a certain wavelength range, emits fluorescent light of a higher wavelength. Many different types 
of fluorescent proteins, covering a large part of the visible spectrum, have been developed over the 
years [53] . Tagging the elements of genetic circuits with fluorescent proteins and monitoring a cell 
population with a motorized microscope (with appropriate sets of filters to separate excitation 
and fluorescent light), allows us to follow individual cells in time and measure the state of 
the genetic circuits of interest [54]. Single- molecule resolution can be achieved [29] by fusing 
the fluorescent protein to a membrane-targeting peptide, which reduces the mobility of the 
fluorophore and thus prevents spreading of the fluorescence signal through the cytoplasm, which 
happens when the protein is mobile. Time-lapse fluorescence microscopy allows for a relatively 
high temporal resolution (on the order of seconds to minutes, depending on the mechanical 
and optical characteristics of the microscope, and on the potential photobleaching that the cells 
undergo) , and permits the simultaneous monitoring of multiple fluorescent markers (limited again 
by the cross-talk among them) . The number of cells that can be tracked is limited by the field 
of view of the microscope. A comparative summary of the features of the different experimental 
techniques discussed so far is provided in Table 1. 



Table 1: Characteristics of dynamical monitoring techniques for gene regulation processes 



Technique 


Temporal 
resolution 


Single 
cells 


Cell 
tracking 


Number 
of probes 


Number 
of cells 


Western blotting 


low 


no 


no 


low 


high 


Real-time RT-PCR 


low 


no 


no 


low 


high 


DNA microarray 


low 


no 


no 


high 


high 


Immunofluorescence 


low 


yes 


no 


medium 


low 


Singie-molcculc RNA-FISH 


low 


yes 


no 


medium 


low 


Flow cytometry 


low 


yes 


no 


medium 


high 


Fluorescence microscopy 


high 


yes 


yes 


medium 


low 
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There are different ways to label the activity of a genetic circuit with a fluorescence protein. 
The most logically direct way is by fusing the fluorescent protein with the protein to be monitored. 
Such protein fusion provides a fluorescence signal that is a direct measure of the protein level. 
However, if the protein being monitored is supposed to have a functional effect in the circuit 
(as is usually the case, for instance regulating the transcription of a gene or activating another 
protein enzymatically) , it is necessary to check that the fluorescence tag that has been attached 
does not disrupt the function of the protein, something that is not always easy to establish. A 
different, much less "invasive" labeling method is to add to the cell (in the case of a bacterium, 
either into its chromosome or on a plasmid), an extra copy of the promoter fused only to the 
fluorescent protein. In that way, the fluorescence signal becomes a measure of the activity of 
the promoter that controls the expression of the protein of interest: when that protein is being 
expressed, the fluorescence signal will increase. Mathematically, we can describe the dynamics 
of the fluorescent protein by means of the following expression: 

rIC 

— = /({P})-<5G, (12) 

where G stands for the concentration of green fluorescent protein (GFP), and {P} represents 
the set of all transcription factors affecting the expression of the promoter from which GFP is 
expressed. This promoter is identical to the one in the genetic circuit whose activity we want to 
measure. The negative term corresponds to GFP degradation. Assuming no differences in the 
translation of GFP and the protein of interest from their respective mRNA, we can identify the 
real promoter activity of the protein of interest as Pa — f{{P}), and from Eq. (12) we get to 
the following rule to obtain the promoter activity from the fluorescent signal G being measured: 

HG 

Pa = ^+SG. (13) 

The first term in the right-hand side of this equation can be obtained by simply deriving the 
fluorescence time series. Thus, provided one can measure the degradation rate of the fluorescent 
protein in a separate experiment (by monitoring the decay of the fluorescence signal following 
a halt in the production of the protein), we can easily calculate the promoter activity of the 
protein of interest. 

Time-lapse fluorescence microscopy has two main limitations. First, when monitoring rapidly 
dividing cells, such as bacteria or stem cells, ^ the field of view fills up with cells rather quickly, at 
which point the natural behavior of the cells, and/or our ability to monitor them, are disrupted: 
mammalian cells, for instance, might start to contact and signal one another, possibly changing 
their mutual behavior; bacteria, on the other hand, might start growing on top of each other 
and we would lose our ability to discern them. Therefore, the standard time-lapse fluorescence 
microscopy setup has a strong time constraint on the maximum duration of the experiment. A 
second problem is that changing the conditions to which the cells are subject in real time is 
not a simple task. These two problems have been solved by growing the cells in microfluidic 
chambers, which can get rid of overflowing cells and allow the addition or removal of nutrients 
and other signals in real time [55] . This setup also enables us to maintain constant the conditions 
to which the cells are subject, something that frequently does not hold in standard microscopy, 
since while cells grow the medium conditions change. Combining microfluidics with time-lapse 
fluorescence microscopy thus provides a way of monitoring the dynamical behavior of genetic 
circuits for long times in well-controlled conditions. In order to obtain a better control over the 
cells, optical tweezers can be used. These devices use the radiation pressure exerted on cells by 

■'Here, "rapid" means that the division time is smaller than the tipical timescale of the genetic circuit of 
interest. 
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highly focused laser beams to trap the cells [56, 57], deform them [58], position them [59, 60], and 
even assemble them into tissue- like structures [61]. The combination of fluorescence microscopy 
with microfluidics and optical trapping thus provides an ideal experimental setup, with which to 
monitor the dynamical behavior of genetic circuits with high temporal resolution and for large 
observation times. 

3 Dynamics of gene regulation 

In this section, we present an overview of the experimental evidence of dynamical behavior 
of genetic circuits, concentrating on examples of how this feature can be used to identify the 
molecular mechanisms underlying the corresponding cellular functions. 

3.1 Oscillations 

In the last decades, an overwhelming amount of evidence has shown that the biochemical state 
of cells is far from being stationary, and that this dynamics has frequently a functional role. The 
simplest case of dynamical behavior is oscillatory activity^, which, as shown in Sec. 2.1.1 above, 
is associated with limit-cycle behavior in phase space. A large number of examples of oscillatory 
activity in biological systems have been identified in the last 30 years, with periods ranging from 
tens of milliseconds (as in the case of electrical pulsing activity in neurons) to months (in seasonal 
rhythms) [62] . Given that nonlinear physics tells us that no more than two degrees of freedom (or 
even one in the presence of delays) are required to generate oscillations [12], it is reasonable to 
expect that periodic cellular activity can be generated by relatively small-sized genetic circuits. 
One instance of such a system, namely an activator-repressor circuit, was given in Fig. 3. In the 
following paragraphs, different examples of oscillatory cellular processes will be given, most of 
which can be associated with genetic circuits with small numbers of components. 

One of the first examples of dynamical behavior at the molecular level that was identified 
and characterized in detail was circadian rhythmicity. Living organisms exist in an environment 
naturally subject to periodic cues, for instance from the light-dark cycle of earth's rotation around 
its axis. As a result, it was evolutionary beneficial for living systems to develop biochemically- 
based mechanisms that allowed them to anticipate the environmental rhythms. Circadian clocks 
have been identified in a wide variety of organisms, with very different molecular circuitry in 
most cases^ [64] . The first molecular models of genetic circuits underlying circadian rhythmicity 
focused on small circuits, containing the main genes that were known to be relevant for the 
phenomenon [65, 66]. These early models already identified circadian oscillations as instances 
of limit-cycle behavior. As new facts and new genes were being identified the models became 
more complex [67], although predictions based on design principles derived from our knowledge 
of simple genetic circuits are still being made [68]. 

A second situation in which periodic behavior is apparent is the cell cycle. As in the case 
of the circadian clock, many phenomenological models relaying on limit cycle attractors were 
proposed early on, well before most of the molecular components underlying the cell cycle were 
identified [62]. Recent years have witnessed a substantial increase of experimental knowledge 
about the cell cycle of a range of organisms including bacteria [69, 70], yeast [71, 72], amphibian 
embryos [73], and mammalian [74] (in particular human [75]) cells, among many others. Using 
that information, molecular models with various levels of detail have been built [2, 76, 77]. 

^The term "oscillation" is being used here to refer to periodic oscillations. 

^In simple organisms such as cyanobacteria, circadian rhythms can in fact arise in pure protein circuits, without 
the need of transcriptional regulation [63]. 
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Signaling networks have also been shown to exhibit oscillatory activity. In 2002, population 
studies suggested that the transcription factor NF-kB, which regulates multiple cellular processes 
including cell proliferation, apoptosis and inflammation, responds in a periodic manner to stim- 
ulation by the cytokine TNF-a [78]. In that same work, those experimental observations were 
used to propose a molecular model of a circuit [Fig. 6(a)] involving NF-kB, its inhibitor IkB, 
and the kinase IKK, which phosphorylates IkB, targeting it for degradation and thus activating 
NF-kB. Subsequent single-cell analyses via fluorescence microscopy confirmed the oscillatory be- 
havior at the level of individual cells [79]. The observed period of the oscillations was around 
2 hours, for the cytokine levels tested. When this circuit was stimulated in a pulsed manner, 
instead of receiving a constant level of cytokine, the pattern of oscillations in NF-kB activity was 
seen to depend in a non-trivial way on the stimulation frequency [80] . This suggests a potential 
role of the oscillations as information processors, taking into account that cytokine signaling in 
inflammatory tissues might be time-dependent. 




Figure 6: Natural genetic circuits leading to oscillatory (a) and excitable (b) dynamics. The 
scheme in (a) is a simplified view of the circuit underlying periodic oscillations in the activity 
of the transcription factor NF-kB. That protein activates transcription of IkB, which binds and 
deactivates NF-kB itself. The resulting negative feedback loop is subject to delays naturally 
associated with the cellular processes taking part in it (transcription, entry into and exit from 
the nucleus, protein binding), and leads to oscillatory behavior. The circuit is affected by the 
cytokine TNF-a through its activation of the kinase IKK, which interferes with the inhibition 
of NF-kB by IkB by phosphorylating the latter. The scheme in (b) represents the core genetic 
circuit underlying competence in B. suhtilis bacteria under stress. Here the master regulator 
of competence, ComK, is activated by the stress-sensing protein ComS, which interferes with 
the degradation of ComK by a protease complex controlled by MecA. This triggers the positive 
feedback loop to which ComK is subject, and competence is initiated. Inhibition of ComS 
production by ComK later terminates the competence excursion, leading to excitable dynamics. 

A different study made use of a microfluidics setup to vary in a controlled manner the level 
of (constant) cytokine signal. A single-cell analysis elegantly revealed that as the amount of 
signal decreases, it is the number of responding cells, but not the average NF-kB signal per 
pulse, that decreases [81]. Therefore one can infer that the limit cycle dynamics disappears 
in a discontinuous manner as the control parameter varies, which is consistent with a global 
bifurcation like the SNIC shown in Fig. 3(f), instead of a local bifurcation like the supercritical 
Hopf displayed in Fig. 3(e). It would be interesting to quantify how the frequency of the NF-kB 
oscillations varies as the control parameter changes across the bifurcation. 

Other examples of oscillatory activity in signaling circuits include the signaling cascade acting 
upon the key regulator of cell proliferation ERK [82] , and various pathways involving the STAT 
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family of transcription factors, which play an important role in the immunological response of 
cells, and are known to interact with NF-kB [83]. In this latter case, the evidence of oscillatory 
activity, affecting the phosphorylated state of the STAT protein, comes only from population 
studies [84]. STAT oscillations have a period of around 2 hours, as the ones in NF-kB, while 
oscillations in ERK nuclear translocation have a shorter period, of around 15 min. The functions 
of these two types of oscillations are unknown. 

3.2 Excitability and bursting 

Periodic oscillations are not the only type of dynamical behavior exhibited by genetic systems. 
The tumour suppressor protein p53, for instance, responds to DNA damage by exhibiting pulses 
of activation, the number of which varies from cell to cell within a population [85]. It is still 
unclear whether these pulses are part of an oscillatory response [86] , or an example of excitable 
dynamics such as the one shown in Figs. 3(b,d), but the current evidence points to this second 
possibility [87]. More likely, this system exhibits the two types of dynamical behavior, depending 
on the condition to which the circuit is subject, as happens in the bifurcation diagrams shown in 
Figs. 3(c,f). In any case, the dynamics exhibited by this system can be used to suggest models 
of genetic circuits that might underlie the response of p53 to DNA damage [86]. 

A situation in which clear non-oscillatory dynamical activity has been reported is the response 
to nutritional stress of the bacterium Bacillus subtilis. The stress response of this organism is 
very rich, including terminal differentiation into a spore, which is a dormant and environmentally 
resistant state, and reversible differentiation into a state of genetic competence, in which the cell 
cannot divide and becomes capable of taking up exogenous DNA [88]. Morphologically, the 
competence state is characterized by noticeable changes in the cell's buoyancy, which enables 
the separation of competent and vegetative cells in population-level studies. In that way, much 
was learned about the biochemistry and the molecular biology of this process (which is very 
interesting for its genetic engineering applications, since it provides a way of introducing DNA 
into cells), without having to see what happens to individual cells. 

Time-lapse fluorescence microscopy, on the other hand, promptly revealed that the reversible 
differentiation into competence was strongly dynamical at the single-cell level, and characterized 
by transient pulses of activity of the master regulator of competence ComK, a transcription factor 
that activates the expression of more than 100 genes that determine the transition to the state 
of competence. Initiation of competence is stochastic, with only a small fraction (around 5%) 
of all stressed cells accessing to it (while the rest sporulate or die, due to nutrient limitation). 
However, once the cells enter into the competent state, they exit from it in a deterministic 
manner: the time spent in competence is much less variable than the initiation time of different 
cells. This is the classical trademark of excitability, as represented in Fig. 3(b). A systematic 
investigation of the genetic network known to be involved in the development of competence 
[89] revealed that a small genetic circuit was responsible for the dynamical process underlying 
the transient differentiation into competence [90]. The circuit, shown in Fig. 6(b), contains the 
master regulator of competence, ComK, the stress-monitoring protein ComS, and the protease 
MecA, which degrades both ComK and ComS in a competitive manner. 

Applying the methods described in Sec. 2.1.1 above, the genetic circuit can be described 
by two coupled ordinary differential equations for the proteins ComK and ComS. This model 
exhibits, for moderate levels of stress (which enters the equations as the parameter controlling 
the maximum expression level of ComS), excitable dynamics that explains the transient differ- 
entiation events into competence observed experimentally. The corresponding phase portrait is 
shown in the upper left plot of Fig. 7. The snapshots on the top row of that figure show three 
time instants of the evolution of a collection of B. subtilis cells subject to nutritional stress. The 



19 




Figure 7: Bifurcation analysis of a genetic circuit in silico and in vivo. Panels (a-c) shows 
phase portraits of the genetic circuit responsible for the transient differentiation into competence 
[Fig. 6(b)], for increasing values of parameter Uk, which corresponds to the basal transcription of 
ComK. Different dynamical regimes are reached, from excitability (panel a), which is the natural 
response to stress, to oscillations (panel b) and monostability at high ComK levels (panel c). 
The corresponding experimentally observed behavior is shown in the snapshots of panel (d), 
with time proceeding from left to right. Red (green) represents the fluorescence protein being 
expressed from the ComK (ComS) promoter. Experimental data kindly provided by Giirol Siiel. 

red and green colors represent fluorescence levels obtained from promoter fusions. The white 
circles in these snapshots highlight one cell undergoing competence. 

Different predictions of this model were tested in order to validate the circuit. Among them 
a bifurcation analysis was made using as a control parameter the basal expression of ComK, 
denoted ak ■ This parameter can be tuned experimentally by adding, via chromosome integration, 
a second copy of the ComK gene under the control of an IPTG-inducible promoter. Adding 
different amounts of IPTG to the medium in which the bacteria grow, one can attain a continuous 
control of basal ComK expression. In parallel, a bifurcation analysis of the model for increasing ak 
can be performed, leading to the conclusion that as the unregulated expression of ComK increases, 
cells tend to a state of permanent competence (something to be expected, since eventually the 
cells contain a high and constant amount of exogenous ComK) , but interestingly they do so by 
passing through a region of oscillatory dynamics, something that is not present in this system 
under natural conditions. Experimental observations confirm this prediction [91], as shown in 
the snapshots of the middle row of Fig. 7. The white circles in this case highlight a cell that 
(together with its daughters, since the duration of the pulse, around 20 hours, is longer than 
the cell cycle time) undergoes two consecutive entries into competence. The state of monostable 
competence (bottom row of Fig. 7) in which all cells end up being competent or spores, is also 
un-natural in these cells. 
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Other perturbations can be applied to the circuit, and can be used to continue vahdating 
the model. In fact, both experiments and theory agree that in this system the duration and 
frequency of the competence pulses can be controlled independently of one another, by tuning 
the basal expression rates of ComK and ComS, respectively [91]. 

Excitable dynamics is being identified in other cellular systems. In particular, recent evidence 
points to its involvement in the maintenance of pluripotency in embryonic stem cells. In fact, 
recent studies have revealed two intriguing features of pluripotency. First, there is substantial 
heterogeneity in the expression levels of certain proteins known to be relevant for the development 
of pluripotency, such as Nanog, while the variability is much smaller in other key players of the 
process [92]. Second, Nanog expression seems to be bimodal in stem cell populations, with 
most of the (pluripotent) cells expressing a high level of Nanog, while a relatively small fraction 
of the cells express Nanog at low levels. These latter cells have been shown to be closer to 
differentiation [93]. More intriguingly, low Nanog cells have been seen to revert back to a high 
Nanog state after some time [94]. These characteristics can be explained by excitable dynamics, 
which naturally leads to (i) a certain level of variability, (ii) a non-trivial distribution of Nanog 
expression, with a certain degree of bimodality (with the more populated state corresponding 
to the stable state of the system, and the less populated one related with those cells that are 
in the excited branch of the phase plane), and (iii) spontaneous dynamical transitions between 
the two states, driven by noise. Under these starting hypothesis, we set out to examine the 
possibility that the genetic network underlying pluripotency might contain a genetic circuit that 
provided a mechanism for excitability. A small genetic circuit containing Nanog and another 
protein relevant for pluripotency, namely Oct4, was seen to allow for an excitable topology in 
phase space. It is appealing to conjecture that the pluripotent state in embryonic stem cells is 
excitable in order to have the cells primed for differentation in the embryo, when needed along 
the development process. This would provide an important functional role for excitability in cell 
dynamics. 

Recently, another strongly dynamical (but non-periodic) behavior has been uncovered that 
could constitute a new means of transcriptional regulation. The evidence comes from the calcium 
stress response of yeast cells [95]. In the presence of calcium, the transcription factor Crzl 
moves to the cell nucleus, where it activates the expression of more than 100 genes involved in 
calcium adaptation. Interestingly, time-lapse fluorescence microscopy revealed that this nuclear 
translocation does not take place in a continuous manner, but it does so in a pulsed manner, 
with rapid and short bursts of localization of Crzl into the nucleus [95]. Even though the 
molecular mechanisms underlying these oscillations are not clear, due to the striking observation 
that the stimulation controls not the amplitude of the localization bursts but their frequency, 
it is attractive to think that cells use this frequency-modulation method of encoding cellular 
signals as a way of reaching coordinated regulation by promiscuous transcription factors, even 
when their different targets have distinct input functions [95]. It can be expected that many 
more pulsing and bursting phenomena will be found in cells in the upcoming years, and will 
be seen to play relevant roles in cellular processes. As an example, a recent work has revealed 
the existence of a refractory time in transcription cycles in mammalian cells [96] , below which a 
second cycle cannot be elicited. Given that refractoriness is one of the key features of excitable 
dynamics, it is appealing to conjecture that the dynamical regime underlying the occurrence of 
stochastic transcription cycles might be excitability. 

3.3 Natural vs synthetic circuits 

A decade ago, synthetic circuits showed us that small genetic circuits can have well-defined 
and non-trivial effects in cells [97, 98]. Examples include genetic oscillators [99, 100, 101, 102], 
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switches [103, 104, 100], stabilizers [105], and counters [106], among many others. Engineering 
delays in a negative feedback loop have also been recently shown to lead to oscillations with 
controllable period in animal cells [107]. Synthetic circuits are ideal to test the hypothesis of the 
existence of core genetic circuits, because they are relatively isolated from the rest of the cell, 
ideally sharing only the resources (but not the regulation) with the rest of the cellular machinery. 

More recently, however, synthetic circuits have also began to help us understand the behavior 
and structure of natural genetic circuits, by revealing the possible behaviors that a given circuit 
architecture has. A recent example of this has emerged in the case of bacterial competence 
discussed in the previous section. A comparison between the phase planes shown in the top 
left plot of Fig. 7 and in Fig. 3(b), and their corresponding circuit architectures, indicates that 
a similar dynamical behavior can be produced by different circuit topologies. The question is 
then how does evolution lifts this functional degeneracy among genetic circuits. Construction 
of an activator-repressor excitable system in B. subtilis by reusing the same components of the 
natural competence circuit (which was subsequently removed, leaving only the synthetic excitable 
circuit in the cell) led to a functional synthetic competence module. Since the two circuits (the 
natural and the synthetic) share most of the components and their interactions, comparing their 
behaviors should reveal differences that are due only to the circuit architecture. Interestingly, in 
this case the comparison unveiled that the natural circuit was noisier than the synthetic one, in 
the sense that the duration of the competence excursion was far more variable from event to event 
in the former system than in the latter [108]. A transformation assay showed that noise would 
be beneficial in the presence of an uncertain environment, providing a reason for the occurrence 
in nature of one of the two circuits over the other. Another systematic study along those lines 
has been carried out in feedforward circuits in E. coli [109]. 

A similar approach has been recently employed to better understand the circuit responsible 
for the pulsing response of p53 to DNA damage described in Sec. 3.2 above. The study showed 
that certain features of the dynamical behavior of the system, namely the amplitude, frequency 
and damping rate of the oscillations, can be controlled by the stimulus level and the circuit 
topology. 

4 Noise in gene regulation 

The experimental evidence presented in the preceding section usually displays a substantial 
amount of noise and variability. Random fluctuations arise, as argued in Sec. 2.1.2, from the 
discreteness intrinsic to biochemical reactions involving a small number of molecules, as is com- 
monly the case in cells. We now review several studies in which stochasticity in genetic circuits 
has been taken into account, describing how noise is measured, how it can be controlled to 
determine its effects, and what are those effects. 

4.1 Observing and measuring noise 

In the early works that quantified noise in bacteria [110, 111] a distinction was made between 
intrinsic and extrinsic noise in gene regulation. Intrinsic noise refers to the stochasticity inherent 
to the biochemical reactions underlying the different processes involved in gene expression and 
regulation: for instance, the random binding of transcription factors and RNA polymerases to 
DNA promoters, and of ribosomes to mRNA molecules. Such fluctuations cause the expression of 
two identical promoters placed in different regions of the chromosome to express different levels 
of protein (even when there are no differences between the transcription efficiencies associated 
with the location the promoter within the chromosome - which is accomplished in bacteria by 
placing the promoter symmetrically with respect to the origin of replication of the chromosome) . 
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Extrinsic noise, on the other hand, corresponds to fluctuations in the number of the external 
species (i.e. those not subject to regulation by the elements of the genetic circuit under study) 
involved in the gene regulation process (including, for instance, signaling molecules and tran- 
scription factors) . In that way, extrinsic noise has no differential effect on the expression levels of 
the two identical promoters described above: both will see the same fluctuations in the external 
components acting upon them. 

The distinction between intrinsic and extrinsic noise is reminiscent of one amply considered in 
the field of statistical mechanics, between internal and external noise. Even though the two pairs 
of concepts share some transversal features (e.g. extrinsic noise is frequently parametric, acting 
upon the system parameters, as is usually the case in external noise), there are certain differences. 
For instance, extrinsic noise, due to its own nature, is strongly modulated by the cell size, and 
thus consistently exhibits a temporal correlation in dividing cells [112]. Thus extrinsic noise 
is usually colored, with a correlation time equal to the cell cycle time. Frequently, this time is 
noticeably larger than other time scales of the cell, and hence cannot be neglected. This contrasts 
with the external noise considered in statistical physics, which can be assumed to be white under 
certain conditions. In any case, the distinction between intrinsic and extrinsic noise makes 
biological sense, and has helped us understand the role of fluctuations on genetic circuits. By 
way of example, extrinsic noise has been identified as the source of qualitatively novel dynamics 
[113, 114] due to its frequently multiplicative character, which leads to systematic effects on the 
average dynamics of the system [115] (although recently, qualitatively novel dynamics emerging 
from intrinsic noise has also been identified [116, 117]). Also, a recent theoretical study has 
pointed out that the correlation between the two types of noise determines in a relevant manner 
the information-carrying capacity of biochemical networks [118]. It is also worth noting that the 
standard Gillespie method for the discrete simulation of genetic circuits incorporates in a natural 
way the intrinsic fluctuations, but not the extrinsic ones. For a recent extension of the method 
that deals with extrinsic noise see for instance [119]. 

4.2 Controlling noise 

In order to determine the effect of noise on the behavior of a given genetic circuit, it would be 
desirable to control its intensity in experiments. One way of accomplishing this relies on the 
interplay between the transcription and translation rates of a given gene. If the transcription 
rate is low and the translation rate is high, mRNA molecules will be created very infrequently, 
and each one of them will produce a burst of protein expression. This is the translational 
bursting regime shown in Fig. 4(b). In the opposite limit, if the transcription rate is high and 
the translation rate is low, the number of mRNA molecules will be large, and the associated 
fluctuations will be small, which will in turn lead to small variations in the protein level. Thus, 
controlling independently (and inversely) the rates of transcription and translation allows us to 
alter the amplitude of the fluctuations without altering necessarily the mean expression level 
of the protein of interest [30]. This situation is shown in Figs. 8(a,b) by means of numerical 
simulations of a simple positive feedback circuit. Figure 8(a) corresponds to the case of strong 
transcription and weak translation, whereas the opposite case is shown in Fig. 8(b). Here the 
translational bursting is not so evident, since the circuit is operating in the upper state of a 
bistable regime. In fact, for the situation of Fig. 8(b) the noise level is large enough to induce a 
jump of the circuit from the upper to the lower state, which corresponds to the circuit turning 
off after approximately 10 hours. In order to apply this method experimentally, it is necessary 
to mutate the promoter region so as to alter the transcription rate, while at the same time 
mutating the ribosome-binding site (RBS, precursor of the mRNA region where the ribosome 
binds in order to start translation), which changes the translation rate [30]. The technique has 
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been recently applied to show that initiation of competence in B. subtilis is stochastic [120]. 

The previous method is local, in the sense that only the noise acting upon a given gene can be 
tuned. Furthermore it requires performing taylored mutations to the promoter and RBS for each 
gene whose noise is to be varied. A more straightforward way of controlling the noise would be to 
do it globally in the cell, for all genes and molecular species. This relies on the fact that scaling 
up the number of all components in the cell would leave all average quantities unchanged and 
only change the noise. In that way the limit of infinite cell size would be a sort of thermodynamic 
limit. An example of this is shown in Figs. 8(c,d). Experimentally, this can be accomplished 
in bacteria by using mutations that prevent the cells from dividing, while they are still growing 
and replicating their chromosome (which is necessary in order to scale up the whole process) . In 
that way, a ten-fold increase in the cell volume, accompanied by a ten-fold increase in the copy 
number of the promoters from which all genes are expressed (so that eventually or mRNAs and 
proteins are scaled up by the same factor), and a ten- fold reduction in the bimolecular reaction 
rates (which depend on the volume [16]) would lead to a ten-fold decrease in the amount of 
noise acting upon the cell. This method has been used in B. subtilis to prove that the initiation 
of competence is stochastic [91]: as the cells grow in size (without dividing) the noise should 
decrease and the probability of competence should decrease, as was found experimentally. More 
recently, this technique has been used to show that Min pole-to-pole oscillations in dividing E. 
coli cells become more regular the longer the cell is, which indicates that the regulation of Min 
activity is cell-length dependent [121]. 

Finally, in certain situations we might be interested in probing how noise in a certain inter- 
action of the circuit affects the behavior of the system. To that end, we would need to perturb 
the circuit in such a way that the average effect of the interaction being probed does not change, 
but only its fluctuations [see Figs. 8(e,f)]. To do that, one can adapt the local method described 
above, by combining a promoter mutation that alters the transcription rate of one species in 
the circuit, with another mutation (in a binding site, for instance) that reduces the activity of 
the resulting protein on its target by the same amount. In that case, we alter the amount of 
noise acting upon that link without changing the average effect on the other system component. 
This method has been recently used, again in B. subtilis, to show that the high variability in 
the durations of competence events is due to the low number of ComS molecules existing during 
competence, and thus to the large noise in the interaction on which ComS is acting [108]. 

4.3 Using noise 

Most of the studies devoted over the years to investigating the effect of noise in the dynamics 
of genetic circuits have concentrated on the robustness of the cell's behavior to the presence of 
noise [122, 123, 124, 125, 126, 127]. Theoretical studies, on the other hand, have indicated the 
possibility that noise induces new states, either stationary or oscillatory [122, 127, 128, 114], or 
enhance information processing in the cell [27]. We have recently proposed, for instance, that 
intrinsic noise is able to stabilize an unstable steady state, leading to a quantized distribution of 
excursion times [116] similar to those found experimentally in the cell cycles of various species 
[129, 130, 131]. In a different context, signaling networks are subject to numerous sources of 
noise, both internal and external to the cell. It is thus tempting to expect that cells would use 
that noise for their own benefit, and in fact a recent study of a Boolean signaling network has 
shown that environmental noise external to the cell in the form of background chatter, is able to 
improve the response of the network to temporally structured input signals [132]. 

Recent experimental evidence of the beneficial effects of random fluctuations in genetic circuits 
regards for instance the response of cells to fluctuating and uncertain environments [133, 134, 
135, 108]. Another situation in which noise plays a useful role is in facilitating developmental 
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Figure 8: Methods to control noise in genetic circuits. The left column corresponds to a local 
method in which the transcription and translation rates are simultaneously and inversely varied. 
The middle column represents a global control of the noise that can be implemented by changing 
the cell volume. The right column corresponds to a circuit-level version of the local model, in 
which two interactions of the circuit are simultaneously and inversely varied. The upper row 
shows a schematic representation of the three methods, with the green arrows representing the 
direction in which the different regulation processes (transcription, translation, and enzymatic 
degradation) have to vary for noise to increase (while the average dynamics is unchanged). Plots 
(a) and (b) show time series of the mRNA and protein levels for increasing noise, and plots 
(c-f) represent typical phase portraits (again with noise increasing going downwards), with the 
activator and repressor nullclines shown in pale blue and magenta, respectively. Note that plots 
(c) and (e) are identical, representing the low-noise benchmark for plots (d) and (f). Light dark 
lines denote typical stochastic trajectories. 
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evolution through partial penetrance of mutants [136, 137]. In the next years we should expect 
to see increasingly more examples of how cells use noise, which is otherwise unavoidable, in a 
constructive manner. 

5 Multicellular dynamics 

Cells, both in unicellular and multicellular organisms, possess multiple mechanisms of commu- 
nicating with one another, in a process that is critical for the survival of any species. From 
bacterial biofilms to the more sophisticated animal tissues, cells coordinate their behavior in 
order to function, and dynamics is not an exception. Given the ubiquity of biochemical oscilla- 
tions, discussed in Sec. 3.1 above, one of the first questions that arose in this area is whether a 
collection of cells with intrinsically dynamic behavior could synchronize with one another [138]. 
The question was biologically important, since organs such as the suprachiasmatic nuclei in the 
mammalian brain, location of the circadian clock, were composed of thousands of cells that had 
to operate synchronically in order to produce a single and clear rhythm [139]. The nature of the 
synchronization mechanism in multicellular circadian clocks is still under debate, although theo- 
retical studies have shown that such synchronization is feasible [140], even under the presence of 
random fluctuations in the illumination level, which can in fact help the cells acquire a rhythm 
even when individually they are arrhythmic [141] . 

Prior to these studies, numerical simulation results have already shown the feasibility of 
synchronizing synthetic genetic oscillators by coupling the cells by means of a quorum sensing 
mechanism [142, 143]. Synchronization reduces the frequency variability of the individual clocks, 
thus converting a collection of sloppy oscillators into a relatively precise clock. Synchronized 
genetic oscillations via quorum sensing have been recently reported in a synthetic system [144]. 
In that case, however, the genetic circuit that generates the oscillation is mediated by the quorum 
sensing molecules, thus the individual cells do not oscillate. 

Depending on the polarity with which the coupling signal is introduced into the cellular oscil- 
lator, other types of collective phenomena besides synchronization may arise [145]. This includes, 
for instance, multistability and clustering [146], chaos [147], and cooperative differentiation [148]. 
When coupled with cell growth, we can use the dependence of the noise on the population size 
[149] to induce differentiation, understood as a population arrest, upon arrival at a certain cell 
density [150]. 

Finally, we turn our attention to natural genetic circuits in which coupling plays a relevant 
role. The most natural field in which this happens is development, since developmental processes 
are intrinsically dynamical and multicellular [151]. In fact, one of the more robust signalling os- 
cillations is exhibited by Hesl, a signaling molecule of Notch, which is one of the major mediators 
of intercellular coupling. Hesl oscillates with a period of around 2 hours, of the same order as 
the oscillations of NF-kB and STAT, both in culture [152] and in vivo. In this latter case, Hesl 
oscillations are an important feature of somite segmentation in the vertebrate embryo. This pro- 
cess is driven by the segmentation clock, a collection of cells located in the presomitic mesoderm, 
which are coupled to each other via Notch-Delta signaling. In an elegant study, the strength of 
the coupling between the cells was varied in a controlled way by chemical means, in order to see 
whether the oscillations disappeared altogether, or if the cells simply became desynchronized. 
The experiments unveiled a clear synchronization transition controlled by the coupling strength 
[153]. 
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6 Conclusion 



Gene regulation is a noisy dynamical nonlinear process. These characteristics are frequently 
encountered by physicists in their studies of inanimate matter, thus it seems a natural step 
to apply the techniques used in physics to the investigation of living systems. In spite of the 
complexity of established genetic networks, dynamical behavior in cells allows us to expect that 
smaller genetic circuits can be associated with specific functionalities. These genetic circuits 
can be studied with standard methods from the fields of nonlinear and statistical physics. Here 
we have presented an overview of some of these techniques, both theoretical and experimental, 
described some of the experimental evidence of dynamical phenomena in genetic circuits, and 
discussed how such phenomena are used to constrain and establish genetic circuits that explain 
cellular behavior. 
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